Papers with keyphrase generation
Representation Learning for Resource-Constrained Keyphrase Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | State-of-the-art keyphrase generation methods depend on large annotated datasets, limiting their performance in domains with limited annotation data. |
| Approach: | They propose a method that first identifies salient information using retrieval-based corpus-level statistics and then learns a task-specific intermediate representation based on a pre-trained language model. |
| Outcome: | The proposed method improves keyphrase generation and zero-shot domain adaptation on multiple keyphrase benchmarks. |
Learning Rich Representation of Keyphrases from Text (2022.findings-naacl)
Copied to clipboard
| Challenge: | Prior work has referred to extractive (part of document) or abstractive (not part of document). |
| Approach: | They propose to use a new pre-training objective to introduce keyphrases into transformer language models in discriminative and generative settings. |
| Outcome: | The proposed model improves performance in discriminative and generative settings and also improves on named entity recognition, question answering, relation extraction and abstractive summarization tasks. |
Keyphrase Generation: A Text Summarization Struggle (N19-1)
Copied to clipboard
| Challenge: | Existing methods for keyphrase generation are unable to produce valuable terms that do not appear in the text. |
| Approach: | They propose to consider the keyphrase string as an abstractive summary of the title and the abstract. |
| Outcome: | The proposed method can generate better keyphrases than the existing methods or the unsupervised ones. |
Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies on keyphrase generation on non-English languages haven’t been vastly investigated. |
| Approach: | They propose a retrieval-augmented method for multilingual keyphrase generation that leverages keyphrase annotations in English datasets to facilitate generating keyphrases in low-resource languages. |
| Outcome: | The proposed model outperforms baselines on non-English keyphrase generation datasets and the proposed model is scalable. |
Keyphrase Generation for Scientific Document Retrieval (2020.acl-main)
Copied to clipboard
| Challenge: | Sequence-to-sequence models have been used to generate keyphrases, but it is unclear whether they are reliable enough for document retrieval. |
| Approach: | They propose a framework for extrinsic evaluation that allows for a better understanding of the limitations of keyphrase generation models. |
| Outcome: | The proposed models improve retrieval performance by supplementing documents with keyphrases that are not present in the source text and generalizing models across domains. |
Select, Extract and Generate: Neural Keyphrase Generation with Layer-wise Coverage Attention (2021.acl-long)
Copied to clipboard
| Challenge: | Generally, documents are truncated before being inputs to deep neural networks, resulting in missing keyphrases . evaluators use layer-wise coverage attention to cover all the critical points in a document . |
| Approach: | They propose a neural keyphrase generation model that identifies the salient sentences in a document and an extractor-generator that jointly extracts and generates keyphrases from the selected sentences. |
| Outcome: | The proposed model outperforms the state-of-the-art keyphrase generation methods on keyphrases generated from scientific and web documents. |
Neural Keyphrase Generation via Reinforcement Learning with Adaptive Rewards (P19-1)
Copied to clipboard
| Challenge: | Existing generative models generate too few keyphrases, but they often generate too many . et al. (2017) propose a reinforcement learning approach for keyphrase generation . |
| Approach: | They propose a reinforcement learning approach that encourages a model to generate sufficient keyphrases with an adaptive reward function. |
| Outcome: | The proposed method improves state-of-the-art generative models with conventional and new evaluation methods on real-world datasets. |
Structure-Augmented Keyphrase Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Creating keyphrases that are likely to be words absent from the given document is challenging . |
| Approach: | They propose novel keyphrase generation tasks that augment missing context by adding keyphrases to documents. |
| Outcome: | The proposed keyphrase generation task outperforms the state-of-the-art in two keyphrase tasks. |
Heterogeneous Graph Neural Networks for Keyphrase Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches for keyphrase generation generate uncontrollable and inaccurate absent keyphrases. |
| Approach: | They propose a graph-based method that captures explicit knowledge from related references. |
| Outcome: | The proposed model improves on baseline keyphrase generation models on multiple benchmarks. |
An Integrated Approach for Keyphrase Generation via Exploring the Power of Retrieval and Extraction (N19-1)
Copied to clipboard
| Challenge: | Existing methods on keyphrase generation are purely extractive or generative . however, extractive methods cannot predict absent keyphrases which are not in the document. |
| Approach: | They propose a multi-task learning framework that jointly learns an extractive model and a generative model. |
| Outcome: | The proposed approach outperforms the state-of-the-art methods on five keyphrase generation tasks. |
One2Set: Generating Diverse Keyphrases as a Set (2021.acl-long)
Copied to clipboard
| Challenge: | Recent keyphrase generation models are wrongly imposing a predefined order on keyphrases . a new training paradigm is proposed to concatenate keyphrase sequences in parallel . |
| Approach: | They propose a training paradigm that concatenates keyphrases in a predefined order . they propose combining a fixed set of learned control codes with a bipartite matching mechanism . |
| Outcome: | The proposed model outperforms the state-of-the-art methods on multiple benchmarks. |
Keyphrase Generation Beyond the Boundaries of Title and Abstract (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to keyphrase generation use only the title and abstract of the articles. |
| Approach: | They propose to integrate full text and semantically similar articles to generate keyphrases from a dataset that includes the full text of the articles along with the title and abstract. |
| Outcome: | The proposed model can generate keyphrases that are present or absent from the text. |
Zero-Shot Keyphrase Generation: Investigating Specialized Instructions and Multi-sample Aggregation on Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Keyphrase generation is a long-standing NLP task for automatically generating keyphrases for a given document. |
| Approach: | They propose to use open-source instruction-tuned LLMs for keyphrase generation . they propose task-specific counterparts to self-consistency-style strategies for LLM . |
| Outcome: | The proposed model improves on existing models and shows significant benefits over baselines. |
Keyphrase Generation with Correlation Constraints (D18-1)
Copied to clipboard
| Challenge: | Existing methods for keyphrase generation ignore correlation among keyphrases, resulting in duplication and coverage issues. |
| Approach: | They propose a new sequence-to-sequence architecture for keyphrase generation that captures correlation among keyphrases by preceding phrases to eliminate duplicate phrases and improve result coherence. |
| Outcome: | The proposed model outperforms the state-of-the-art method on benchmark datasets in terms of accuracy and diversity. |
Diverse Keyphrase Generation with Neural Unlikelihood Training (2020.coling-main)
Copied to clipboard
| Challenge: | Recent advances in neural natural language generation have made possible remarkable progress on the task of keyphrase generation, however, the importance of diversity in keyphrases has been largely ignored. |
| Approach: | They propose to train a sequence-to-sequence keyphrase generation model from the perspective of diversity. |
| Outcome: | The proposed model achieves large diversity gains while maintaining competitive output quality. |
Keyphrase Generation via Soft and Hard Semantic Corrections (2022.emnlp-main)
Copied to clipboard
| Challenge: | Extensive experiments show that CorrKG is capable of generating high-quality keyphrases. |
| Approach: | They propose a correction model CorrKG on top of the MLE pipeline to correct the biases . the adaptive adaptive mass learning scheme is designed to better fit OT and FreqFS . |
| Outcome: | The proposed model overcomes the semantic biases in keyphrase generation using OT and FreqFS techniques. |
Data Augmentation for Low-Resource Keyphrase Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing works on keyphrase generation rely on large-scale annotated datasets, which are not easy to acquire. |
| Approach: | They propose to use full text to improve keyphrase generation in resource-constrained domains by using the full text of the articles to augment their methods. |
| Outcome: | The proposed methods improve both present and absent keyphrase generation on three datasets and show that they are cost-effective. |
A Preliminary Exploration of GANs for Keyphrase Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on extractive keyphrases have shown promising results, but the results suggest that there is room for improvement. |
| Approach: | They propose a new keyphrase generation approach using Generative Adversarial Networks (GANs) their model produces a sequence of keyphrases and a discriminator distinguishes between human-curated and machine-generated keyphrase. |
| Outcome: | The proposed model outperforms the state-of-the-art generative models on benchmark datasets and is comparable to the best performing extractive models. |
On Leveraging Encoder-only Pre-trained Language Models for Effective Keyphrase Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | a new study examines the use of encoder-only pre-trained language models in keyphrase generation (KPG) keyphrases are phrases that condense salient information of a document. |
| Approach: | They propose to use encoder-only pre-trained language models in keyphrase generation . they also examine optimal architectural decisions for employing encoder only PLMs in KPG . |
| Outcome: | The proposed model outperforms general-domain seq2seq models in keyphrase generation. |
ERU-KG: Efficient Reference-aligned Unsupervised Keyphrase Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for keyphrase prediction rely on heuristicically defined importance scores . existing methods lack consideration for time efficiency . |
| Approach: | They propose an unsupervised keyphrase generation model that combines informativeness and phraseness modules. |
| Outcome: | The proposed model outperforms baseline models and achieves 89% of the performance of a supervised model for top 10 predictions. |